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this paper aims to propose an automated classification system used to 
classify different types of leukocytes based on the convolution neural 
Keywords: network (CNN) algorithm. CNN has achieved robust performance in various 
fields especially in medical applications. A dataset of microscopic blood 
cells images of the conforming tags (basophil, eosinophil, erythroblast, 
lymphocyte, monocyte, neutrophil, and platelet) was used to train and test 
the proposed algorithm. The augmentation and deep transfer approaches 
VGG-19 were used to improve and enhance the performance of the CNN algorithm. 
The overall accuracy of the proposed classifier was 98% with Visual 
Geometry Group-19 (VGG-19). The obtained accuracy was higher than the 
state-of-art algorithms. To conclude that using the augmentation and deep 
transfer approaches with VGG-19 can obtain better classification results. 
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1. INTRODUCTION 

The blood is the liquid that flow inside the human body through the vessel. It consists of three main 
parts known as cells, these cells are: red blood cells (RBCs), white blood cells (WBCs), and platelets [1]. 
The human immune system mainly depended on leukocytes (white blood cells) which in turn are strictly 
connected to several diseases [2]. Leukocytes are mostly separated into five sorts (neutrophils, basophils, 
eosinophils, monocytes, and lymphocytes) [3]. Diagnosis the sort of Leukocytes has a serious necessity on 
the physician's medical knowledge and their experience. The detection of each type of leukemia differs for 
physician to another in terms of the skill to discover WBCs, thus this issue can lead to critical errors [4]. 
Where, hematologists usually detect blood cells number and classify them using microscope device. 
This procedure is wasteful, and the count and cataloguing outcomes are affected by human errors [5], [6]. 
To solve these problems, recently studies focusing on using artificial intelligence (AI) to address these 
problems, either by the using support vector machine algorithm (SVM) based on machine learning, or the 
further progressive approaches are convolution neural network algorithm (CNN) [6]-[13]. 

Prinyakupt and Pluempitiwiriyawej, presented the WBCs classification based on the naive and linear 
Bayesian schemes [14]. The procedure was used 477 blood cell images using nuclear and cell segmentation. 
Furthermore, Gupta et al., presented an enhanced binary batch algorithm to classify WBCs according to the 
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texture and shapes. It attained a regular output classification accuracy of 92.77% on 237 images [15]. 
Although, these schemes attained higher outcome, cell images need to be pre-segmented that consume time 
and produce human error as well as losing some important features during segmentation process. 

To overcome the previous problems, the deep CNN show higher performance and excellent results 
in the field of medical application [16]-[18]. Zhang et al. presented a synergic deep learning (SDL) 
prototypical to answer several issues of intra-class and inter-class variances produced by medical tomography 
and pathological variety [19]. Ma et al. proposed blood cell image classification algorithm based on a deep 
convolutional generative adversarial network (DC-GAN) and residual neural network (ResNet). The proposed 
system deals with white blood cell (WBC) only, which make it a little complex, time consuming and excluded 
the red blood cell [1]. It is also shown relatively low output accuracy 91%. 

In this study, the convolution neural network algorithm based on the deep transfer learning has been 
proposed. These frameworks can present the complex procedure of segmentation and extraction features 
likened with the old-style machine learning system. It offers the solution of the tricky into an end-to-end 
simple method, and solve the fault produced by the phases for example the segmentation and feature 
enhancement in the conventional algorithm, which can improve the acknowledgement and classification of 
blood cells. 


2. METHOD 

A collection of blood cells images of the conforming tags (basophil, eosinophil, erythroblast, 
lymphocyte, monocyte, neutrophil, and platelet) were used as a training and testing dataset. Online available 
of microscopic high-quality peripheral blood cell images dataset has been used in this study [20]. Before the 
training process of the CNN architecture, all images were considered for the being of related. 

The predicted approach comprises a series of processing steps, instead of using long term 
enhancement methods to produce the suitable algorithm that boost the pre-trained network performance. 
Most of the previous studies used deep augmenting approach to generalize and eliminate over fitting in their 
model without figure out the important of using the objective of this process and make it a facility to 
compensate of complex image processing steps [21]-[25]. The proposed algorithm facilitated the 
augmentation method in smart procedure to reduce the image processing steps. The framework of the 
classification system is shown in Figure 1. 


Figure 1. The framework of the proposed blood cells classification system 





2.1. Convolution neural network (CNN) 

CNN or ConvNet is a deep learning algorithm consisting of a number of layers. CNN has achieved 
an excellent performance in the various fields particularly in medical applications [26], [27]. The CNN has 
been reduced using sharing biases and weights comparing to other neural network approaches. The structure 
of the CNN composes of fives layers: input, convolution, pooling, connected hidden, and softmax layers. 
The input of the neural network is an input layer representing pixels matrix of the target image. Red green 
blue (RGB) image is considered as an input image in the most of the CNN architecture. 

Convolution layers are the most important layer of CNN. The convolution procedure of the input 
image is performed at the convolution layers to extract the feature maps. The Kernel filter is the element that 
implements the convolution operation in this layer. The kernel is applied to the local receptive field of the 
target image. Dot product is performed between a patch of the image and the kernel as shown in (1) [28]. 
The W symbol in (1) refers to the filter weight. While the b is the filter bias and the x is the image patch. 


2i Wi xi +b (1) 


The sub-sampling layer or the pooling layer is used to minimise the input image size, therefore the 
training computations and parameters of CNN will be reduced. The max-pooling layer has been mostly used. 
The fully connected hidden layers follow the pooling and convolution layers. At these layers used 
to connect the neurons of the first connected layers. The image feature maps are combined to use in the 
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classification processing of the images. The number of classes in the input images is equal to the number of 
neurons in the last fully connected layer. 


2.2. Augmentation approach 

The refining classification accuracy also be contingent on the number, and orientation of the 
database images. Based on that the augmentation technique is used. The augmentation method involved 
random reflection, and random rotation in angles (0-360), as shown in Figure 2. The benefit of these steps 
is to improve the CNN vision for blood cell features. It also boosts the model generalization. As a result, 
it improves the performance of the designed network [29]. 





Figure 2. The generated blood cell images by transferred VGG-19 


2.3. Deep transfer approach 

The main goal of the deep transfer approach is to reuse the knowledge of the used model that had 
been already acquired good knowledge through training and testing with a wide range of the global net 
dataset. This acquired knowledge can use to solve the new task of a new specific database. This approach 
will allow reducing the required dataset for the training model, in addition to superior improvement for 
learning performance [16]. The performance of the transfer model for diagnosing blood cell limited by 
several issues. For example, the chosen pre-trained deep learning model, the kind and amount of training 
samples, and the pre-processing steps. This study depends on the weights of the transfer method that learns 
from shared weights among the source and target of pre-trained models. Therefore, it can be used to deliver 
more improvements in classification accuracy as well as reduce the total training interval [30]-[32]. 


2.4. Pre-trained model 

The deep prognostic prototypical has been considered based on a pre-trained model, which was 
established by Oxford Visual Geometry Group [VGG] and call a VGG-19. The VGG pre-trained 
is constructed on 3x3 convolution layers. Then, the extra Conv and Relu layers are added to upsurge the 
depth of the model. Lastly, the max-pooling layer is used to condense the size of output features which are 
more willingly learned by a fully connected layer of 4,096 nodes [33]. 

In this paper, the fully connected layer has been settled to the number of classified sorts, which will 
improve the model performance and reduced the training time. Figure 3 shows the proposed model 
construction. Figure 4 shows the 64 channels of the features extracted at the first convolution layer. 
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Figure 3. The proposed model of transferred pre-trained VGG-19 





Figure 4. The feature channels of blood cell image from the first convolution layer of the proposed 
transferred VGG-19 model 


3. RESULTS AND DISCUSSION 

During training the proposed model, each type of blood cell image has been used. The augmentation 
process included such as reflex and rotation has also been used to produce training samples. After 10 epochs, 
the entire model produced upright results, the test loss touched the least value, and the agreeing test output 
validation accuracy was 98.15% with elapse time: 521 min, and maximum iteration: 6,800. The confusion 
matrix is shown in Figure 5. While Figure 6 represented the plotting of training progress of 10 epochs for the 
proposed transfer VGG. 

The accuracy of both validation and training are shown in Figure 6(a). The training accuracy of the 
proposed model starts at 70% and increased with every epoch during training. The loss achieved at the end 
of each epoch is illustrated in Figure 6(b). The model shows a small rate of loss and a large rate 
of classification. 

The output classification results show a superior comparison to state-of-art studies. This was 
obtained by choosing the correct pre-trained model VGG-19 that proved its ability to classify the different 
medical images in various areas [34]. It is also worth mentioning that a well understanding of the 
augmentation method and using the deep transfer leering approach can be lead to an increase in the accuracy 
of the classification system. All these approaches led to gain superior classification results compared to the 
previous studies as shown in Table 1. 
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Figure 5. Performance of the artificial neural network from transferred VGG-19 
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Figure 6. Training progress plot of the transferred pre-trained VGG-19: (a) accuracy and (b) loss 


Table 1. The comparison between the proposed and the state-of-arts systems 


Model Accuracy % 
DC-GAN-ResNet [1] 91.68 
VGG-16 [23] 96 
Inceptionv3 [23] 95 
Proposed model 98.1 
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4. CONCLUSION 

Using the convolution neural network algorithm based on the augmentation method and deep 
transfer learning was the main contribution in this study. The augmentation method used to reduce the 
pre-processing time for features extraction, while, the deep transfer learning used to obtain a higher accuracy 
comparing with the previous studies. The results of this study also confirm that using of augmentation 
method not only reduces the pre-processing time but also evades the fault produced by the segmentation and 
feature enhancement stages in the conventional algorithm. The overall accuracy that has been obtained for 
the proposed classification system is 98% with VGG-19 which is satisfactory and higher than the previous 
studies. This study focused on the certain types of blood cells (leukocytes) which play an important role in 
the function of the human immune system. This is considered as the base for a new diagnosis system to help 
haematologists to give the right decision and reduce human error. 


REFERENCES 

[1] L. Ma, R. Shuai, X. Ran, W. Liu, and C. Ye, “Combining DC-GAN with ResNet for blood cell image classification,” Medical and 
Biological Engineering and Computing, vol. 58, no. 6, pp. 1251—1264, 2020, doi: 10.1007/s11517-020-02163-3. 

[2] Z. Jiang, X. Liu, Z. Yan, W. Gu, and J. Jiang, “Improved detection performance in blood cell count by an attention-guided deep 
learning method,” OSA Continuum, vol. 4, no. 2, pp. 323-333, 2021, doi: 10.1364/OSAC.413787. 

[3] Z. K. K. Alreza and A. Karimian, “Design a new algorithm to count white blood cells for classification leukemic blood image 
using machine vision system,” 20/6 6th International Conference on Computer and Knowledge Engineering (ICCKE), 2016, 
pp. 251-256, doi: 10.1109/ICCKE.2016.7802148. 

[4] A. Khashman, “IBCIS: Intelligent blood cell identification system,” Progress in Natural Science, vol. 18, no. 10, pp. 1309-1314, 
2008, doi: 10.1016/j.pnsc.2008.03.026. 

[5] Y. Duan et al., “Leukocyte classification based on spatial and spectral features of microscopic hyperspectral images,” Optics and 
Laser Technology, vol. 112, pp. 530-538, 2019, doi: 10.1016/j.optlastec.2018.11.057. 

[6] S. S. M. Sheet and M. S. Jarjees, “Microcontroller based in vitro hematocrit measurement system,” Indonesian Journal of 
Electrical Engineering and Computer Science (IJEECS), vol. 18, no. 2, pp. 717-723, May 2020, 
doi: 10.1159 1 /jeecs.v18.12.pp717-723. 

[7] R. R. O. Al-Nima, M. K. Jarjes, A. W. Kasim and S. S. Mohammed Sheet, “Human Identification using Local Binary Patterns for 
Finger Outer Knuckle,” 2020 IEEE Sth Conference on Systems, Process and Control (ICSPC), 2020, pp. 7-12, 
doi: 10.1109/ICSPC50992.2020.9305779. 

[8] T. J. S. Durant, E. M Olson, W. L. Schulz, and R. Torres, “Very Deep Convolutional Neural Networks for Morphologic 
Classification of Erythrocytes,” Clinical Chemistry, vol. 63, no. 12, pp. 1847—1855, 2017,do1: 10.1373/clinchem.2017.276345. 

[9] S. Joshi, R. Kumar, and A. Dwivedi, “Hybrid DSSCS and convolutional neural network for peripheral blood cell recognition 
system,” IET Image Processing, vol. 14, no. 17, pp. 4450-4460, 2020, doi: 10.1049/iet-ipr.2020.0370. 

[10] L. Lin, W. Wang, and B. Chen, “Leukocyte recognition with convolutional neural network,” Journal of Algorithms and 
Computational Technology, vol. 13, pp. 1-8, 2018, doi: 10.1177/1748301818813322. 

[11] D. Alhelal, A. K. Younis, and R. H. A. Al-Mallah, “Detection of brain stroke in the MRI image using FPGA,” TELKOMNIKA 
(Telecommunication Computing Electronics and Control), vol. 19, no. 4, pp. 1307-1315, Aug. 2021, 
doi: 10.12928/TELKOMNIKA.v19i4.18988. 

[12] S. S. M. Sheet, T.-S. Tan, M. A. As’ari, W. H. W. Hitam, and J. S. Y. Sia, “Retinal disease identification using upgraded CLAHE 
filter and transfer convolution neural network,” ICT Express, pp. 1-9, 2021, doi: 10.1016/).icte.2021.05.002. 

[13] S. S. M. Sheet et.al., “Cotton-wool spots, red-lesions and hard-exudates distinction using CNN enhancement and Transfer 
Learning,” Indonesian Journal of Electrical Engineering and Computer Science(IJEECS), vol. 23, no. 2, pp. 1170-1179, 
Aug. 2021, doi: 10.1159 1/yjeecs.v23.12.pp1170-1179. 

[14] J. Prinyakupt and C. Pluempitiwiriyawej, “Segmentation of white blood cells and comparison of cell morphology by linear and 
naive Bayes classifiers,” BioMedical Engineering OnLine, vol. 14, no. 63, pp. 1-19, 2015, doi: 10.1186/s12938-015-0037-1. 

[15] D. Gupta, J. Arora, U. Agrawal, A. Khanna, and V. H. C. de Albuquerqueb, “Optimized Binary Bat algorithm for classification of 
white blood cells,” Measurement, vol. 143, pp. 180-190, 2019, doi: 10.1016/j.measurement.2019.01.002. 

[16] K. T. Islam, S. Wijewickrema, and S. O'Leary, “Identifying Diabetic Retinopathy from OCT Images using Deep Transfer 
Learning with Artificial Neural Networks,” 2019 IEEE 32nd International Symposium on Computer-Based Medical Systems 
(CBMS), 2019, pp. 281-286, doi: 10.1109/CBMS.2019.00066. 

[17] T. Pansombut, S. Wikaisuksakul, K. Khongkraphan, and A. Phon-on, “Convolutional Neural Networks for Recognition of 
Lymphoblast Cell Images,” Computational Intelligence and Neuroscience, pp. 1-12, 2019, doi: 10.1155/2019/75 19603. 

[18] M. J. Mohammed, E. A. Mohammed, and M. S. Jarjees, “Recognition of multifont English electronic prescribing based on 
convolution neural network algorithm,” Bio-Algorithms and Med-Systems, vol. 16, no. 3, pp. 1-8, 2020, doi: 10.1515/bams-2020- 
0021. 

[19] J. Zhang, Y. Xie, Q. Wu, and Y. Xia, “Medical image classification using synergic deep learning,” Medical Image Analysis, 
vol. 54, pp. 10-19, 2019, doi: 10.1016/j.media.2019.02.010. 

[20] A. Acevedo, A. Merino, S. Alférez, A. Molina, L. Boldt, and J. Rodellar, “A dataset of microscopic peripheral blood cell images 
for development of automatic recognition systems,” Data in Brief, vol. 30, 2020, doi: 10.1016/j.dib.2020.105474. 

[21] M. A. Parab and N. D. Mehendale, “Red blood cell classication using image processing and CNN,” bioRxiv, pp. 1-12, 2020, 
doi: 10.1101/2020.05.16.087239. 

[22] M. Akil, Y. Elloumi, and R. Kachouri, “Detection of Retinal Abnormalities in Fundus Image Using CNN Deep Learning 
Networks,” State of the Art in Neural Networks and their Applications, vol. 1, pp. 19-61, 2021, doi: 10.1016/B978-0-12-819740- 
0.00002-4. 

[23] J. L Orlando, E. Prokofyeva, M. del Fresno, and M. B. Blaschko, “Convolutional neural network transfer for automated glaucoma 
identification,” in Proc. 12th International Symposium on Medical Information Processing and Analysis, 2017, 
doi: 10.1117/12.2255740. 

[24] M. Sharma, A. Bhave, and R. R. Janghel, “White Blood Cell Classification Using Convolutional Neural Network,” 
Soft Computing and Signal Processing, pp. 135-143, 2019, doi: 10.1007/978-98 1 -13-3600-3_13. 


Leukocytes identification using augmentation and transfer learning based ... (Mohammed Sabah Jarjees) 


[33] 


[34] 


g ISSN: 1693-6930 


T. Pansombut, S. Wikaisuksakul, K. Khongkraphan, and A. Phon-on, “Convolutional Neural Networks for Recognition of 
Lymphoblast Cell Images,” Hindawi, Computational Intelligence and Neuroscience, vol. 19, pp. 1-12, 2019, 
doi: 10.1155/2019/7519603. 

Z. Cai and N. Vasconcelos, “Cascade R-CNN: Delving into High Quality Object Detection,” Computer Vision and Pattern 
Recognition, pp. 1-9, 2017. [Online]. Available: https://arxiv.org/pdf/1712.00726.pdf 

Z. Kayumov, D. Tumakov, and S. Mosin, “A convolutional neural network for handwritten digit recognition,” Procedia 
Computer Science, vol. 171, pp. 1927-1934, 2020, doi: 10.1016/j.procs.2020.04.206. 

A. Çınar and S. A. Tuncer, “Classification of lymphocytes, monocytes, eosinophils, and neutrophils on white blood cells using 
hybrid Alexnet-GoogleNet-SVM,” SN applied science, vol. 3, no. 503, pp., 1-11, 2021, doi: 10.1007/s42452-021-04485-9. 

A. Schwaighofer, V. Tresp, and K. Yu, “Learning Gaussian process kernels via hierarchical bayes,” presented at the Proceedings 
of the 17th International Conference on Neural Information Processing Systems, 2004. [Online]. Available: 
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.69.3527&rep=rep1&type=pdf 

D. S. Kermany et.al., “Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning,” Cell, vol. 172, 
no. 5, pp. 1122-1131, Feb. 2018, doi: 10.1016/j.cell.2018.02.010. 

F. Damayanti, S. Herawati, Imamah, F. Ayu, and A. Rachmad, “Indonesian license plate recognition based on area feature 
extraction,” TELKOMNIKA (Telecommunication Computing Electronics and Control), vol. 17, no. 2, pp. 620-627, 2019, 
doi: 10.12928/telkomnika.v1712.9017. 

Liliana, J. Chae, J.-H. Lee, and B.-G. Lee, “A robust method for VR-based hand gesture recognition using density-based CNN,” 
TELKOMNIKA (Telecommunication Computing Electronics and Control), vol. 18, no. 2, pp. 761-769, 2020, 
doi: 10.12928/telkomnika.v1812.14747. 

O. S. Zhao et. al., “Convolutional neural networks to automate the screening of malaria in low-resource countries,” peerJ, vol.12, 
no. 3, pp.1-20 , 2020, doi: 10.7717/peerj.9674. 

S. Karthikeyan, P. S. Kumar, R. J. Madhusudan, S. K. Sundaramoorthy, and P. K. K. Namboori, “Detection of multi-class retinal 
diseases using artificial intelligence: An expeditious learning using deep CNn with minimal data,” Biomedical and Pharmacology 
Journal, vol. 12, no. 3, pp. 1577-1586, 2019, doi: 10.13005/bpj/1788. 


BIOGRAPHIES OF AUTHORS 





Mohammed Sabah Jarjees © Eg P received the B.Eng degree in Medical 
Instrumentation Technology Engineering, 2002, and the Technical Master Degree in Medical 
Instrumentation Technology Engineering, 2006 form Technical College of Mosul, Northern 
Technical University, and Mosul, Iraq. He received the PhD in Biomedical Engineering, 
University of Glasgow, Glasgow, United Kingdom, 2017. He is currently assistant professor 
and works as head of Medical Instrumentation Technology Engineering Department. 
He can be contacted at email: mohammed.s.jarjees @ntu.edu.iq. 


Sinan Salim Mohammed Sheet © É:I P received the B.Eng in Medical Instrumentation 
Technology Engineering, Technical Engineering College of Mosul, Mosul, Iraq 1999 and 
M. Sc degree (Electrical-computer and microelectronic system) in 2011 from University 
Technology Malaysia (UTM), Skudai, Malaysia. He can be contacted at email: 
sinan_sm76 @ntu.edu.iq. 


Bassam Tahseen Ahmed © F:4 P received the B.Sc.Eng (Electrical and Electronics 
Engineering) degree from Military College of Engineering, Baghdad, Iraq in 1999 and M. Sc 
degree (Laser Engineering) in 2005 from the University of Technology, Baghdad, Iraq. 
He can be contacted at email: bassam_raoof @ntu.edu.iq. 


TELKOMNIKA Telecommun Comput EI Control, Vol. 20, No. 2, April 2022: 314-320 


